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Abstract of JP200 11 75869 
PROBLEM TO BE SOLVED: To provide a 
speaker's hand position detecting device and its 
method which can accurately and speedily 
search for the positions of the eyes and face of a 
speaker through video and are tolerant of video 
noise. SOLUTION: This device includes an eye 
position detecting means 10 which detects a pixel 
showing a relatively strong gray feature in video 
and decides as a candidate area an area 
showing partial cohesion characteristics and 
having a texture feature in the area that the pixel 
forms, a face position determining means 20 
which determines an optimum search template 
among search templates formed matching a 
position extracted from the candidate area of the 
eye, and an extraction position stabilizing means 
30 which determines the position area of the 
speaker by using the optimum search template. 
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y rectangle) JMtS. 

[0039] flgRrVrU- Mi, WBtftffltfw&ti* 
Rffi(= i o T ttWftfcSt IT 0fc#<3;*f fotfEHBt * * 

wmzmfc < mtt n-^mzfim^firzEnm 
xhh. 

[0040] J#K**'JJg*rSl4 2(2, iSDUt'J 4 3 
t?B(IS*ifc#tf 9 *Mzn l Xfi *j y fe* 
/RUBHft ^HB« K^i&t * * ? >- h tttov vt (£8 
Jus*, WWH^»hco^(c^fE^^ * ^ y b 

[0041] m.®&9.mi§44^ ffliWJ 4 3P 

immiv* *yyh mmmitzmmm tmm 
mmt ucswrt*. w/wmvmM4 5 
(2, m^mmnm*zzmmrmm&ix, 
m& * ums4 2 1 i 0 mmfzu. wztizm 

[ 0 0 4 2 ] OT, *WH»IMNrt*tilWHcR"»t 
£. H2, 05&V06 (A) »e>m (D) & 

*m?te-fm±m£tz&. tw^-M 



:tfg^YUV(2, fe^»2 1tj;D3feff^RGBt 
36*5*1*. 

[0043] *wwttjv^T, awfiaBW}«>fcftt# 
3mcosm%mit ix , ^y-m&xsm 

S. 

[0044] 05{±, iwid^sacofipassiHffts 

fctf>*SST*S. 05W21 6£fc*tl/C#2tScf-3 

n-3 2ft^iEffis^fc ^coiEmmMm^itz 1 ft 

(C MB0EMmiHH***ftv>raBtf fc L,T**l/tjSS 
*i* i £ . i 0 ft 3 «0>8f8tf>iffl£tf fcffl 

fmi&fct immcomm^m^xh & . 

[0 04 5] 06 (A) |i, MPEGTffl^6il*fW 

«*4ffl^««isi-0-c*6. zmmt. ±tmk 

IfttmU^ttHead & Shoulde 
r) 06 (A) CftilWt*S<lS«t3 

t=, mmimmz&^mwm^Bi&mm* 

[0046] Ltztfi x , ®.mm&U2 2 ti. men 
-^<nv9±Mznhx*j-it^&mm±mi 

mtm wmmattt v > 0 ^mmm ix , m 

UJ-f*. 06 (B) (±. icoxiKjx&wmz^tv 

f'zHZfa&LtzhnZ^-tmxfoh* 06 (B) Tli 
[0047] j; $ +j&WZ9±MzmhWVm 

\zmh^m%^^h t . mmim^mmmfi 
mzmix^tix^&$\ -gM^mommm&v 
9^Mnmm-x%ts:mxh->tz 0 . tmmmfc<&t 

-otz'OLX^LX^hZ.bm^. ttthh. Zcv 
it. -JtWlcltfi* UtM . 3 fti!-5««^ 

[0048] smmmu 22frt>&nz tvkx. 7 

■7-tMzft LT+Hfi (median)7^jW"J^ 
t 'J V^tL^f*. 2 5 C J: o 

[0049] aHftttas-c(±iiwo*ifii^^ § ®m 



!(9) 00 1-1 75869 (P20 0 1 - 1 7 5 869 A) 



Mk&mWttM&t»t LTHaralick(Co 
mputer & Robot Vision, Add 
i t i on -We s 1 eyPub. , 1 992)fcJ:l> 

risss: ( 2 ) w& ( 3 ) im^zttrntLw 

[0050] 
C12] 

[0051] 

[0052] I5E^ ( 2 ) atfiSiBS ( 3 ) 4>, 
litfiittjKWIri, c k ) T"£>^Tk = 0, 

M^r-v?*?* 1 ), TK (4) 
foh. 

[0053] 

(r-c) - (4) 

[0054] MB^ ( 2 ) ZStWrafK ( 3 ) fcj: otl 

*«ww4R0«fiWi.6. **$, ^fc^-r^j^a 

* Lvv-sat^KiitWi. i^ R /<y R €* J l. 2fc& 
gSsh.fca*, ^9J0>KI8Ri£;h.lcl6£3iiS fcOTIi: 

[00 5 5] mmcom BR(Minimum Boun 
ary Rectangl e) t*ftT«Ufc(«/ 

fcfl S -H«<^JBITtt . ffl*It# 0 . 7 <£ D /h $ V ^ 
*\ 4fcl±3. SJiOfcSolKWiast'JIfeWi*. * 

«tf s lR l )lifc&*.*. *f^fc«S-fQfc<9®Jirefci, fS 

ft ) / 1 6 0 0 j: 9 A£ WUf *0«WB4K 0 N&frh. 

3 § # * & 9 fc A# >, *JBIBT* 9 , * S k ^±Jt$SE 

[ o o 5 6 ] H6 ( c > a, mmmm^m^xmm 
LiZT9x**W&&7fitl><vzhh. me (O fci 
S fc . mi ? owaFttoUK i 9 g wa^TitlKWSfiv i 

v ^x -y s;«T3i < * $*tl> fc v ^ m#i> h . 



SOT, *TX » i^WfeJ^-JtWfcfl**-* - fc 

*X,fc*S#tf)*£3ISWS ifcfc J^T @ofl£fifM£ 
[0 05 7] H6 (D) Ji. iWJSfcl/CJi&itiLfcft 
fc2fI#tt-fl><0T\ g^&B^gSftl-fc. dilfc 

[0 0 58] H3, H7 (A) ^07 (C) N RX/M 

7 (A) *»fcH7 (C) tt, tf^^-b^ffl^ 

7*4. 07(B) (i, ^ffi^^gOfilifMfcSI* 
3«-?7 fy^§hfc8SiaifyrV-h (face 

template) <7)ff^^LT^|> 0 
[0 0 59] tT>fy7*U-h{^ **3!W6{frC* 
S fc rt^fc I OfflSSirf Zo^njg« t Tit 

9.-th Z fc SS«*«rtSfc***i-C w^f* 
[0060] orfcs fi^^/t^rV^yTb— h<?)F*I 

afcA^w^jiofflii^fefcmM^w^afc i 

-hfi. 4ffl<0ffF**LT8eR'r>'ru-hfcffl«S 
SW-*. t**>fe, Z^fc*f-tS4fflcoSfc4fflc7)*» 

afc *«* § wTsatiia^&^t izt m&ct> h . 
H7 (o ii, ftRWfcgasfiftB^xiiifcttassfi 

[006 1 ] ^fc?»Lit*iM(±, gwfilfci o« 

fe$tL^«sgryru-hfc«u-ria*igi«'tsi^& 

( 1 ) AwWi&JfftfcflKTCts 9. A^O^Jf fico^l? 
{iHRfc-^S9ffl*#tS. !BB9^»tt*«SHtf S fc 

*\ *aMhO««fcSt LT A««^SJf 

fflfc t, <ot* & - fc < wsf^*^^ 

cowmmmmtiztmmxht. m^m. 2 

ftjC&SSfirCtfVX (Gaussian) #=ft£:fif £ 
fclKJ&r&S. t?t#'oT, Mi.iim^«MPEGfc" 

7**««"Cft«ftfcas? LTiafHis*aj-f s i fc tf-e 

#4. i^lttt^fOTUTil7 (B) -CS^ofcSiSR. 



(*10))01-175869 (P2001-175869A) 



T>Tu-hmnm®mm£&^frz^m lanobi smammt ixm^x^z. 
mm z t mmxh s . *mm& -m [ o o 6 2 3 

lfi^«T"(iTEie ( 1 ) £J;-5-aKiJ3fl.SMa h a [ft 1 ] 

d , (xH*-^) t S' , (»-^) - < L > 



[0063] mEiS: ( l ) fctswc, <UiSt*ffiK-c* 

[0064] ( 2 ) HA^^fiSRr^T-l/- hTJSjfl 

71/- h tistt* S 0 OiBtf>f8«aMNi , 

914 § 4tffi£* L T x -y jHi8fK#£ Lft ^ . L 

[00 65] ( 3 ) BOSfl-tf)*^ -y v(iffi*fWfcA 

lESfcSfifcB*)*** .y Sii, MfcPM-fSfc 

[ o o 6 6 ] H7 ( b ) ?*5rofcaK mmryru 

-hlzftLX, £Lttf) ( 1 ) (3) C03ocr)ilgc7) 

[0 0 6 73 -*. s»^fyri/- b36»s*§n 

•c jm, § fut t ai i x mt sipWi asw 
Adapter s tot wjjo tr . a* Lfcfuwr t km* 

«ft5if-y7V-bSr^g-ri.o oftjISSrJIl 

x Bff>msxm(om.'&mtsi-ti z 1 a^T* & . 

[00 68] OT. H4. 07 (C) ^#HSLT. ttffi 
17 (C) GSSftSiSfc. 

mmmrAixmztitzBtmtco^yru-Hz 
mmtrzmx'^t^tit z t msxhh. mm 

fty-y"yx (natura I image sequ 
e n c e s ) t £<0ti*i^# , l&ft 

A*mmmmTm%<mmiz£-->xmzm&m 
[0 0 6 9] Ltzff-ox. fzttmtbxm^mmizAn 



fc^LTii. ztit>-"ocr)W.mziitfhmm±%«7)i%i 
^amttWBt^Tkt, zatiwim 
nmm* t> m&mmmw&mm^ . smut* 

[0070] i ^ ft^gSHA^wiir^^f* 

ttajflttffitt»«£«W\ H7 (C) t^SfLSSfcffi 
[ 0 0 7 1 ] «:i£^§**ffittt ( m o m e 

nt) ^l-csd. a § mz , 
3t*ft*&3Sfb&*£ 1 t i>fflBfctifmreit*ami£ 
ittf£<KmztiZc^mfom&. mz. mtx/jni. 

<0fflWtt*qSPfet5 J: 5 Cft S . 1 »Sfc 0 2 

o~3o tfc<o#{atisft s nfc tf^wie a§ fc * - 

i#Bc07l— ATliSWc^SL^*^' ( i + 1 ) 
#B^7 1'-A-cfSSfc&ffltfrarf 6 i 3 ft z t tt, 
(5,^v\ j; 9 ft^ti^ffiScOfflMttSfiJ 

[0 073] m^7V-h.<n-X%%w&.(n±i^v 
l, ^v^Mznm-thii^yymw&vcth, <x 

fc. tttB§il^liOMBRSnjIA7jt. ^cOMBRft 

§ixfcH<7)MBRSA7jL, MeL^Sfc^<NtiS 
[ 0 0 7 4 ] t, L - ftffiSfUt M B R*esai!wsit3sa 
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[ o o 7 5 ] jet , mb Rwmmxnmw.* t'J<0 
# 7 y hffl*^ 0 il LT*^3#U o tsfitwur o s 

«*tr«B*f & i at**, ^m^t-mmmm 

XU , *">>M*«0~7 <9lU»ffi£ J: 5 fcfc 
S . £ (7) i 3 £jfijg£» 0 jit J; a 

[00 76] Lfctfo-r. MtM* 
4 LtfftSft L * i ^ftiyitf)* ? y h mtifit 

« t wwr* - 1 #t§ 4 . 
stas*w»*ffl**#si-s sat tTfl^ij-r-s i 3 1 

[ 0 0 7 7 ] £ *> J: 3 * JBtt*flt* * 'J <0 

x\ m<mnm, mmmm&. tammmz 

co±n s tfwm'te v ^ t« , * ^ y h xr v 

[0078] iJB««fg^»^«^«iiB!«;«agtc 
t$wc % A<9lI^fSi$2«^SW&P#C^*ft£§»fiR 
OI (region of interest)}:^ 

PEG— 1 s MPEG-2, MPEG-4, H. 263 

W^yzi-yzf3^x&m$titztym±i$t&zt 
[0079] -rarfct,, *«BB«»t«<^ifcl»<iSfvM!H 

Wffiv >!Wc9H«*itt»^5rv M1HBMT5MS £ 1 1 J: 

mi mmmmzmmti z t vx% & . 
[ooso] *«BH»aa Lv^of^t j;4iSL# 

ruyy^xim^mxh o . a ^d^as 

^SX->T. iUfflr-f ^^aytfjL-^-^xf- at 
gfrt S - fc S 4 . £ C9 J: 3 3riB»«*i: UT 

ttijum mm. rom, 7o»t- 



IMft (Witf. CD ROM, DVDf ) &tf«B£» 
[ 0 0 8 1 ] *S»»C*tLT*tf>a* L^HM?) 

mm^^m^mnxm^titzwmxmx'^ t 
z t im% izmmztifti i> coxh i . zmi. zz 
tzm&ztitimmmt* m$Lm%mxm< 

^ . xmnmum it:mw>*£.mz 
ti6iy^xm<mm^mm^7r^tixa^) , *ti 

[0082] 

wtmcr)imk$:£t)jEmiz. ifri>£m<mi&-f 
z t vxz . *tsix>mm$£ m < lx ztit>m 
miztifx^h. 

[0083] ffjhLfc1TftaWtt< ! ffft** 

-f-i. ^iwtfiffl art gr. g cofiaayn^fs^ 
Ts sa^mst/M^ijjra^tgt^o, a»W«ttU=Sr 
■<oaaj * ^rwc^-* i fc *st§ s . 

[0 084] ^fflWmiSSi*«, Bft^ 

[Hi ] *mmzi%&~Mcomi^immiz£&wn 
[02 ] 0 1 {c*^*^tffi6-w<oBffijittaj^a 

* ± 0 BWfc^ Lfc 7"n -y ;«0TS> § . 

[03 ] *«BBt«S-W<0»filK({S#a* J: DPffl 
{e^Uc7'n./?fl§j£0T£>&. 

[04 ] *ffe^Kffi6-WO«iaifiiKEfefl:^S* J: 0 

[05 3 W»e>14S^^iM0>11-4^O0ffiT* 

5. 

[06] 06 (A) fri? (D) (i, icr)«fl«^ai 
t4JH!*il»t*fc«X0Hiirc&4 . 
[07] 07 (A) fr>£> (C) (i, 

aa*iKBr 4^Aco0ffiT*4 . 
[08 ] ititM peg wmxmco&mmiii ztitzzt 

io gffia^ai^g 
20 nffijf^^a 
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30 tttmmc&tm 



r— i i — ' — i 



[03] 




[04] 



3- 



1 — H 



| »K>*y | — 43 
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l®5] 




[H8] 
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C@6] 

(A) 





(B) 










(C) 


mm 


mifm 




(D) 
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(72)*BB# & Q M <72)#»f A ft » 

*ftsn v^urawi ttttg ffin-s *wsn **j8 wea e^s? 593 

7#ffi HT^-h 17« 1101-9- #tfi SB#r^<-h WIS 1504f 
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02mm m m « 

2mm $uLT*-h 3m 501^ 



F 5B057 
5C066 
5L096 



BA02 CA01 CB01 CE06 CE18 
DA08 DB06 DC09 DC16 DC25 
DC32 

AA11 BA20 CA21 EB03 EE02 
EF11 GA01 GA02 KC08 KC09 
KD06 KD07 KE04 KE07 KE24 
AA02 BA18 CA04 EA45 FA06 
FA15 FA18 FA32 FA33 FA69 
GA55 JA09 



